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BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a computer interface device for controlling the position of 
a cursor on a computer monitor. More generally, the device can be used to detect a user's position 
and translate this position into a distinguishable input for a computer. 
Description of the Related Art 

Most computers today use a "mouse" to control the location of a cursor on the screen. It 
is important to be able to quickly and accurately position the cursor, especially when working with 
programs having a graphical user interface. The mouse is a simple device which uses a roller ball. 
As the mouse is moved, the roller ball moves two perpendicular sensors. One sensor detects 
movement towards or away from the user. The other sensor detects movements to the left or right 
of the user. These movements can be referred to as measured on an x-y plane. Thus, even 
angular movements will produce both an x-component and a y-component. These values are then 
translated into movement of a cursor displayed on the monitor. 

The mouse, while revolutionary in its day, has numerous mechanical parts which can break 
or malfunction. A common problem is the accumulation of lint, carried by the roller ball and 
lodged against the sensor. This prevents the sensor from properly recording the movement of the 
roller ball. Further, the ball can become irregular with time, making it more difficult to roll. 
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Another problem occurs when the mouse is placed upon a smooth surface. Even if the surface of 


2 


the roller ball is textured, it can slide rather than roll. Again the result is unpredictable movement 


3 


of the cursor on the screen. 


4 


A final problem exists regarding a handicapped user's ease of use. If the user has no hands 


5 


or has been crippled, a tactile device such as a mouse is difficult to manipulate. A need exists for 


6 


a method and apparatus to control a cursor's position without the use of a tactile mechanical 


7 


device. Such a device in a more generic sense could be used in any hand's free interaction with 


0 8 

y2 


a computer. For example, a severely handicapped user should be able to manipulate the device 


u= 9 


with the movement of a straw-like extension held in his mouth. 


5 10 


Such a computer interface need not be solely restricted to the manipulation of a personal 


In 


computer. Many industries have used automated machinery to improve the efficiency of their 


012 
M 


production. The machinery is controlled by a program. Safety hazards are presented when 


y ; 


workers work in proximity to automated machinery. It would be beneficial to have a means to 


iF 5 ) 

= 14 


detect the location of a worker and alter the movement of the automated machinery to avoid that 


15 


location. 


16 


Finally, a need exists for an input device which seamlessly integrates with modern 


17 


three-dimensional graphic displays. For example, "virtual reality" goggles and autostereoscopic 


18 


projection devices produce three-dimensional images. A new input device is needed which allows 


19 


a user to interact with the image without invasive tactile attachments. 
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1 SUMMARY 

2 The present invention relates to a three dimensional, gesture recognizing computer 

3 interface. Its mechanical design allows its user to issue complex data to a computer without the 

4 use of a keyboard, a mouse, track-ball, or similarly tactile forms of cursor/input/tool control. Its 

5 desktop and laptop configurations are designed to contribute further to simplifying the workplace. 

6 The device can be attached to a keyboard or a monitor or any other location in proximity to the 

7 user. 

O 8 The control device uses analog circuitry to determine the amplitude of change in the 

j*j 9 dielectric area of an orthogonal array of conductors. Changes in tank-oscillators within the analog 

^10 circuit are produced when a person disturbs the equilibrium of the dielectric regions of the 

pll geometrically arranged conductor array. The control device typically guides a travel-vector 

Q 12 graphic indicator as feedback to user gestures. In another embodiment, the sensitivity of the unit 

y 13 is increased to recognize specific smaller user gestures. Also known as pick gestures, a user could 

/5j 14 merely tap a finger downward to simulate the pressing of a mouse button instead of a larger 

15 arm-pointing gesture in a less sensitive embodiment. 

16 In a broader application, a panel sensor can be placed on the wall of a room. The location 

17 of a user within the room can be detected. Multiple panels can be linked together to establish 

18 greater sensitivity and accuracy. One application of this configuration is safety on the factory 

19 floor. The panels can detect the presence of a worker and alter the path of automated machinery 

20 in order to protect the worker. 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 To further aid in understanding the invention, the attached drawings help illustrate specific 

3 features of the invention and the following is a brief description of the attached drawings: 

4 Figure 1 illustrates the general motion of a user's hand being detected by the computer 

5 interface device of the present invention; 

6 Figure 2 is a graphical representation of the output from the detector circuit when a 

7 "bounce" is detected; 

Q 8 Figure 3 is a schematic of the detector circuit; 

ys 

Tu 9 Figure 4 is a flow chart illustrating the software interpretation of the circuit output; 

Hi { 

^ 10 Figure 5 , 5a, 5b and 5c illustrate a monitor mounted embodiment of the present invention; 

XT. 

P : : 11 Figure 6 illustrates a wall panel embodiment of the device; 

5 

Q 12 Figures 7a to 7h illustrate a plurality of wall panel elements used to scan for movement 

C 13 within a room; 

% 14 Figure 8 illustrates the use of detectors on the dash of an automobile to eliminate the need 

15 for certain manual controls; 

16 Figure 9 illustrates the use of detectors on an automatic teller machine; 

17 Figure 10 illustrates a table with a plurality of motion detectors mounted thereon; 

18 Figure 11 illustrates a motorized wheel chair having an array of conductors; and 

19 Figure 12 illustrates a robotic arm having detectors mounted thereon. 



203269. l/SPA/35684/0101/010699 



35684.P002 



DETAILED DESCRIPTION OF THE INVENTION 



The present invention relates to a computer interface device and more generically to a 
control device which senses a user's movements to initiate control actions. Figure 1 provides a 
general illustration of a user 10 gesturing within a field established by a first, second, and third 
conductors 102, 104, and 106. The third conductor 106 is extending from the page in the z-axis. 
The conductors establish a capacitance with the air acting as a dielectric. The dielectric constant 
is disturbed by the presence of the user's hand or other extremity. Alternatively, the user's hand 
or other extremity forms the second plats of the capacitor along with the conductor. Movement 
of the user then alters the capacitance of this capacitor as the body provides a virtual ground to 
close the circuit. For example, the movement of the user's finger 12 in the upward direction as 
shown in the second frame creates a disturbance or "bounce effect." A detector circuit will sense 
this change, for example, as a voltage bounce 108 as shown in Figure 2. 

Two of many types of gestures are illustrated by the two models: 



-where "y" is the magnitude of the device output and "x" is an iteration, or unit of time, 
-"a" and "b" are the derived coefficients of the model based on the data. 

If for example the user reaches toward a single conductor, and then withdraws, the gesture 
may modeled using the Quadratic form. If the user repeats the gesture continuously, the output 
would be modeled using the Sinusoidal form. 




Quadratic Fit: y = a + bx + ex A 2 



Sinusoidal Fit: y=a+b*cos(cx+d) 
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1 The two forms may be superimposed to scale upon the other. For example, were the user 

2 to reach out towards a single conductor and at some fixed point began fluttering his fingers, and 

3 then retract his hand, he would then need two samples: sample one, the entire gesture, and 

4 sample two, the disturbance to the Quadratic form of sample one. The fluttering fingers would 

5 be sinusoidal if the sample were to be reduced to just the oscillating fingers and not the broader 

6 arm gesture. Although it might be possible to model the system as a higher order differential 

7 equation, a programmer would choose to adjust the sampling to acquire key gestures and stimuli, 
p 8 For example, in the demonstration of reaching in, fluttering fingers, and then withdrawing, 
IjJ 9 original Quadratic is disturbed. The wise programmer who fits the data to the quadratic will 

ru 

^ 10 notice that the residuals of the function are oscillating and apply the second fit to the residuals over 

pll the disturbed sample area, thereby isolating and analyzing the embedded gesture in one step. 

2 

Q12 One of the most important issues that engineers must deal with today is the ergonomic 

0 13 qualities of their devices. . Consumers are highly informed about the health problems caused by 

m 

;314 poorly designed, non-ergonomic products. From cars to computer keyboards, designers are 

15 obligated to take into consideration the user's comfort when designing a product. The utility of 

16 the control device 100 is that it is by nature ergonomic. The user does not impact any surface 

17 while using the device. The detector can also be refined to produce the desired output in response 

18 to comfortable performed motions by the user. Thus, if the control device is replacing a computer 

19 mouse, it need only be calibrated on several occasions before the user obtains an almost effortless 

20 ease in manipulating the cursor on the computer screen. 
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Figure 3 is a schematic of a detector circuit suitable for the present invention. The three 
conductors 102, 104, 106 are attached to x-axis, y-axis, and z-axis proximity detector circuits 110, 
112, 114, respectively. As each circuit is similar, only the x-axis circuit 110 will be discussed. 
The detector circuit 110 is a cascade amplifier utilizing BJT transistors. The circuit is supplied 
by a regulated voltage supply 116. The circuit shows the use of three BJTs 120, 122, and 124. 
In a preferred embodiment, BJTs 120, 122 are model MPS3704, while BJT 124 is a model 
2N3904. The biasing voltages can be adjusted through the use of various resistors and capacitors. 
Preferred values are shown. The input from the conductors are conditioned and amplified by the 
three proximity circuits 1 10, 1 12, 1 14. The output from the circuits are provided through the axis 
data information lines 118 to the computer. 

Within the computer, the analog output signal is converted into a digital signal which can 
be manipulated. The analog to digital (A/D) resolution is important to the Control device in 
several ways. The further the stimulus is away from the receiver (Ah is large) the smaller the 
change in voltage (aV) sent from the analog circuit to the A/D. Therefore the A/D must be 
sensitive enough to detect the minute changes in the fringe region of the orthogonal array. The 
ideal control device has operating conditions residing solely in its optimal region where little or 
no resolutional nonlinearity occurs. Since a completely linear-unified 3D region-model for the 
array is desirable, the greater the resolution of the A/D, the greater the robust range of input. 

Alternatively, a circuit that directly measures the oscillator frequency would provide a 
more sensitive (and probably easier to linearize) means of measuring position. In this case, the 
oscillator output would be fed directly into a frequency to digital converter (F/D). This can be 
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implemented in the computer. The F/D converter would simply involve gating the oscillator into 
a counter for a fixed interval, T. The contents of the counter N would be related to the oscillatory 
frequency, f by f=N/T. This process would be repeated with sufficient frequency, perhaps one 
hundred times per second, so that the output would, for the purposes of display or control, be 
continuous. 

Since the actual change in capacitance caused by insertion of hands (or other objects) into 
a region of sensitivity is very small, perhaps of the order of 10 8 farads, the nominal or 
"undisturbed" frequency of the oscillator must be made relatively high. This is done to achieve 
a suitably large frequency swing when the region is "disturbed" by the presence of hands. The 
total frequency swing thereby becomes suitably large in an absolute sense, but is still very small 
as a percentage of the "undisturbed" or nominal oscillator frequency. 

The overall sensitivity of the system can be enhanced by heterodyning the output of each 
variable oscillator with a common fixed oscillator, then using the resulting difference frequency 
for measurement purposes. To illustrate this, consider an undisturbed frequency of 1 . 1 megahertz 
(LlxlO 6 cycles per second) and a maximum frequency swing, created by disturbing the field, of 
10 kiloHertz (10,000 cycles per second). This amounts to a total frequency swing of less than one 
percent. If, however, the oscillator output is heterodyned with a fixed one megahertz signal, the 
resultant undisturbed frequency is 0.1 megahertz (or 100 kiloHertz) and the frequency swing of 
10 kiloHertz (which is unchanged) is equivalent to ten percent, a ten-to-one improvement in 
sensitivity. 
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1 Figure 4 is a flow chart 200 which diagrams the interaction between the data collected from 

2 the conductors and the software program that translates that data into cursor positioning or other 

3 control actions. The input data 202 is initially collected and stored in a buffer. An initial 

4 calibration is then performed, establishing output limits based upon the input. The new data is 

5 then compared to the values used during the calibration. The differences are then used to create 

6 vector data 204 used to create new cursor position output. This raw vector data is then sized to 

7 best fit the monitor 206. Next, the vector quantities are applied 208 in an absolute sense to 

S 8 previous coordinate data. For example, the x-axis and y-axis values can be position or 

, s 

jj 9 movement data. Z-axis values can be interpreted as scale values. Next, the cursor is plotted 210 

j2 10 in its new position using the vectors added to its old coordinates, additive method, or to a default 

""if'" 

Q 11 position, absolute method. 

O 12 Figure 5a is a preferred method of implementing the interface device to a personal 

^ 13 computer. The apparatus 300 produces overlapping input and output regions 302, 304, using a 

14 first and second array of conductors 306, 308. Each array of conductors can contain any number 

15 of conductors, although four conductors is preferred. The first set of arrays 306 can be placed on 

16 the front of the monitor, while the second set can be placed on the keyboard. The user can then 

17 pass his hand or any other device in the overlapping field where it will be detected. 

18 Figure 5b and 5c illustrate the use of the invention with an autostereoscopic display. Such 

19 displays can produce a three dimensional illusion or perceived image in front of the display. Such 

20 displays are produced by Neos Technology of Melbourne, Florida. In the example, a tennis ball 

21 312 is displayed within the region banded by output regions 302, 304. Thus a user 314 can extend 
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1 his hand into this bounded region and interact with the three-dimensional display. The location 

2 of his hand is detected and the illusive ball 312 can respond to the illusion of touch. 

3 Figures 6, 7a, and 7b illustrate the use of a multi-conductor panel 400. The panel 400 has 

4 any outer surface 402. On the outer surface, at least two conductors are 404, 406. The 

5 conductors are connected to a central input/output controller 310. Thus any capacitance 

6 disturbance detected by the conductors 404, 406 can be relayed to a detector circuit such as 

7 described above. Further, the panels can be connected to each other with a data bus 408. Thus, 
g 8 an entire room can be paneled with detector panels 400. The panels 400 room can be interrogated 
W 9 with various patterns to detect the location and limits of movement of a device within the room. 
^ 10 For example, in Figure 7a, only the conductors on the panels which represent the very axes of the 
P 1 1 room are activated. Sequentially, the pattern can be changed to include the conductors illustrated 

Q12 in Figures 7b, 7c, 7d, and 7e. 

M 

dl3 Once connected, the panels can also be segmented to create specialized quadrants. For 

w 

*14 example, as shown in Figure 7f, if the room contained an automated machine 418, the panels 

15 closest to the machine ! s operating motion 420, 422 might be used to create the most accurate 

16 detection of motion. Further, as shown in Figure 7h, if more than one object is moving in the 

17 room, e.g. a worker near the machine, then two detection groupings 430, 432 could be analyzed. 

18 Figure 8 illustrates the use of the detectors in an automobile interior. A dashboard could 

19 have virtual controls that were activated by the movement of a driver's hand. An exemplary 

20 dashboard 500 could contain a plurality of conductor arrays 502, each with at least two conductors 

21 504, 506. If the array 502 represented the radio control, a user could adjust volume by pulling 
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1 his hand away from the array, and change channels by using a recognized hand gesture such as 

2 the formation of a J-shape with outstretched fingers. Of course the choice of commands and 

3 functions can vary. 

4 Figure 9 illustrates the use of a conductor array 902 at an automated teller machine 600. 

5 This might be particularly useful for the blind. A blind user could approach the automated teller 

6 machine. When detected, the user could move his hand toward a desired key and be guided by 

7 a volumed plurality of tones. As he neared the key, for example, the volume could increase or 
0 8 the plurality of tones may be in unison when they were otherwise dissonant. 

9 Figure 10 illustrates a work table 700 containing at least one set of conductor arrays 702. 

i 

£ 10 Machinery could be mounted on the table and monitored. Likewise, as on a work floor, the 

Q 1 1 interaction of human operators and machinery could be monitored. Thus, if it appears that the 

Q 12 worker might be injured by the movement of the machinery, then the movement can be altered or 

M 

jjp 13 the machine powered down. 

^ 14 Figure 11 illustrates a motorized wheel chair 800 for use by a handicapped person. The 

15 wheel chair has a seat 804 connected to several wheels which are powered by a motor 802. The 

16 chair 800 typically has a desk top surface 806. Prior art motorized chairs typically have a simple 

17 lever controller. The user presses the lever forward to move the wheel chair forward. The user 

18 moves the lever to the side to move the wheel chair to the left or right. The use of a movement 

19 detector can replace a lever arrangement so long as there is a limiting filter present to subdue the 

20 "bounceMike signal produced if the moving chair were to hit a bump to prevent erroneous control 

21 input while the chair is in motion. For instance, a first array 810 can replace the lever controller. 
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1 The user would merely manipulate his hand or other object within the range of the conductors. 

2 The changing capacitive field will be interpreted as discussed above. A second conductor array 

3 808 can be placed on the desk top as well. The desktop can be shielded to prevent the user's leg 

4 movement from affecting the field around the conductors. 

5 Figure 12 illustrates an embodiment of the invention wherein the conductors are placed on 

6 the moving armature of a machine. In this example, the conductors 902 are placed on a robotic 

7 arm 900. In the past examples, the conductors have been placed on a stationary object. This 
0 8 example illustrates that the opposite arrangement can also work. In other words, the robotic arm 

9 can be in movement around a stationary work piece that will be detected. 

E U 

^10 Although preferred embodiments of the present invention have been described m the 

p 1 1 foregoing Detailed Description and illustrated in the accompanying drawings, it will be understood 

s 

O 12 that the invention is not limited to the embodiments disclosed, but is capable of numerous 

^ 13 rearrangements, modifications, and substitutions of parts and elements without departing from the 

14 spirit of the invention. Accordingly, the present invention is intended to encompass such 

15 rearrangements, modifications, and substitutions of parts and elements as fall within the scope of 

16 the appended claims. 

17 Other embodiments of the invention will be apparent to those skilled in the art after 

18 considering this specification or practicing the disclosed invention. The specification and 

19 examples above are exemplary only, with the true scope of the invention being indicated by the 

20 following claims. 
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